SEMI-ANNUAL PROGRESS REPORT 

NASA RESEARCH GRANT NSG 1442 " 

■ - 

Performance Analysis of a Generalized 
Upset Detection Procedure __ . , 

by 

Douglas M. Blough and Gerald M. Masson 


Performance Analysis of a Generalized Upset Detection Procedure* 

Douglas Af. Bio ugh and Gerald Af. Matt on 

Department of Computer Science 
The Johns Hopkins University 
Baltimore, MD 21218 


Abstract - In this paper, a general procedure for upset 
detection In complex systems, called the data block capture 
and analysis uptet monitoring process. Is described and 
analyzed. The process consists of repeatedly recording a 
fixed amount of data from a set of predetermined observa- 
tion lines of the system being monitored (l.e. capturing a 
block of data), and then analyzing the captured block In 
an attempt to determine whether the system Is functioning 
correctly. The algorithm which analyzes the data blocks 
can be characterized In terms of the amount of time It 
requires to examine a given length data block to ascertain 
the existence of features/conditions that have been 
predetermined to characterize the upset-free behavior of 
the system. The performance of linear, quadratic, and log- 
arithmic data analysis algorithms Is rigorously character- 
ized in terms of three performance measures* (1) the pro- 
bability of correctly detecting an upset, (II) the expected 
number of false alarms, and (111) the expected latency in 
detecting upsets. 

1. Introduction 

In this paper we consider an approach to upset detection in 
complex systems. The approach is based on a data block capture 
and analysis monitoring process which can be modeled in very 
general terms, thereby rendering our results broadly applicable. 
The process consists of recording signals on a set of observation 
lines of the system to form (capture) a data block and then 
analyzing this block of data. On the basis of this analysis, a deter- 
mination is to be made as to whether the system is functioning 
correctly or has been upset by some fault condition. 

One possible implementation of the data block capture and 
analysis process could be a concurrent monitoring device. Figure 1 
is a schematic which illustrates this perspective of concurrent 
monitoring. 

A key aspect of the data block capture and analysis moni- 
toring process is that its implementation, whatever form it may 
take, should be relatively simple when compared with the complex 
system being monitored. In other words, the process is not meant 
to duplicate the performance of the system. Accordingly, the 
analysis that is performed on a captured block of data will not be 
an explicit comparison of results with the system being monitored. 
Rather, the analysis should be thought of as an examination of 
the captured data block in which an algorithm is executed in an 
attempt to ascertain the existence of features or conditions that 
have been predetermined to characterize the upset-free behavior of 
the system. 

In order to characterize the performance of the data block 
capture and analysis monitoring process, we must consider the 
four possible outcomes which could result from execution of the 
analysis algorithm on a captured block of data: 

Assuming the system was upset during the capture of a data 
block, there are two possible outcomes: 
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Figure 1 - A Concurrent Monitor Employing 
the Data Block Capture and Analysis Process 

the data analysis algorithm could perform correct detection by 
indicating that the system was in the upset state 

or 

the data analysis algorithm could perform incorrect rejection by 
indicating that the system was in the noupset state. 

Assuming the system was not upset during the capture of the 
data block, there are two possible outcomes: 

the data analysis algorithm could generate a false alarm by indi- 
cating that the system was in the upset state 

or 

the data analysis algorithm could perform correct rejection by 
indicating that the system was in the no-upset state. 

We will want to theoretically analyze the upset detection 
capabilities of the data block capture and analysis process in 
terms of the single monitoring period error probabilities, the pro- 
babilities of faise aiarm and incorrect rejection resulting from a 
captured block of data. These error probabilities characterize the 
capability of the data analysis algorithm on a single block of data. 
To analyze the overall performance of the process, we will intro- 
duce measures of upset detection capability called the probability 
of correct detection |l|, (or more succinctly, the detection probabil- 
ity), the expected number of false alarms per upset, and the 
expected detection latency . 

Heretofore, evaluations of an upset monitor’s performance 
could only be achieved by implementing or simulating the monitor 
and then experimentally determining its upset detection capabili- 
ties [2|,j3|. Our measures will permit an analytical evaluation of 
the performance of the data block capture and analysis process 
based on key parameters of the process. 

2. Preliminaries 

An upset is a disruption of correct system behavior. Upsets 
are caused by faults or underlying failure mechanisms in the sys- 
tem. The faults can be permanent or intermittent/transient in 
nature. In general, these faults occur at such a low level in the syv 
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tem that they axe, unto themselves, of no use relative to con- 
current monitoring. It is the effect of the faults on observable sig- 
nal lines of the system with which we must be concerned. Jo order 
for correct detection of an upset to take place, a data block would 
have to be captured at a time when the signal activity on the 
observation lines was showing evidence of the upset. However, we 
will assume that the entire captured data block need not indicate 
an upset for correct detection to take place. Rather, in general, if 
any portion of the captured data block shows evidence of an 
upset, we will assume that it is possible for the process implemen- 
tation to perform correct detection. Furthermore, the implementa- 
tions are not expected to be infallible. Even if the entire captured 
data block showed evidence of an upset occurrence, it would still 
be possible for an incorrect rejection to take place. Likewise, if the 
captured data block showed no evidence of an upset, there would 
still be the possibility of a false alarm occurrence, 

GWen our perspective of upsets and their detection, we can 
model the occurrence of upsets in the system as a two-state 
continuous-time Markov process, moving between the states upset 
and no-upset. This is illustrated in Figure 2. In this model, both 
the time of occurrence and the duration of the upsets are random. 
The infinitesimal matrix. A, characterizes a continuous-time Mar- 
kov process (4|. For our model. 



where the no-upset state is state 0 and the upset state is state 1. 
It is implied by this model that the time the upset condition does 
not exist is exponentially distributed with parameter X, and the 
time the upset condition is active is exponentially distributed with 
parameter fi. A continuous- time Markov model such as this has 
been used to model both individual fault conditions within digital 
systems |5|, as well as system-level upsets (6|,(7|. An upset will be 
said to occur at the time that the system enters the upset state. 
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Figure 2 * A Continuous Markov Model 


3. The Data Block Capture and Analysis Process 

The data block capture and analysis process consists of 
repeated applications of & two-phase function: 

In the data capture phase of operation, a sequence (block) 
of data signals (cycle- by-cycle relative to the system clock) on the 
selected observation lines is stored (captured). We will denote the 
length of the captured data block by the parameter n. 

In the data analysis phase of operation, an algorithm, 
which examines the most recently captured data block for evi- 
dence of an upset, is executed. 

We will refer to the total amount of time spent by the pro- 
cess in the data capture phase and the data analysis phase as the 
monitoring period. 


Implementation of the data analysis phase of the process 
requires execution of a data analysis algorithm which examines the 
captured data block for variations of predetermined 
features/conditions of signal activity. These features/conditions 
could be based on properties of the functions being computed |8|; 
or they could result from a use of coding theory |9|, or an embed- 
ding of signatures in the signal/data flow [lOj; or they simply 
could be experimentally extracted using pattern recognition tech- 
niques [11|,|12|. These techniques encompass both tpecijication 
based [3|, as well as symptom based (13|, diagnosis. 

3.1. The Data Analysis Algorithm 

Certainly, the upset detection capability of the data block 
capture and analysis process depends on the amount of time allot- 
ted to the analysis of captured data. More time spent examining 
the captured data intuitively corresponds to a more thorough 
analysis of the block and a higher probability of correctly detect- 
ing (the more subtle) evidence of an upset. We can generally 
characterize this analysis time in terms of the complexity of the 
data analysis algorithm employed by the process implementation. 
Since n is the length of the data block captured, we will consider 
data analysis algorithms that require a number of execution steps 
that are linear, quadratic, and logarithmic functions of n. For each 
such data analysis algorithm, the time required for execution will 
be assumed to be proportional to the complexity, and we will 
denote this analysis time by the function T(n). The following 
table lists the data analysis algorithms which we will consider in 
the remainder of the paper. 


Data Analysis 
Algorithm 

Execution Time 

Constraints 

Linear 

T L (n) = an 

a > 0 

Quadratic 

TqM — an 2 +bn+c 

a > 0 
b > 0 
c > 0 

Logarithmic 

T L cc( n ) = an-log n 

a > 0 


Table 1 


3.2. Error Probabilities 

‘ We are led by. the above discussion to consider a means of 
assessing the single monitoring period error probabilities of the 
data biock capture and analysis process. These error probabilities 
describe the extent to which the data analysis algorithm produces 
the incorrect outcomes (incorrect rejection or false alarm) during a 
single data analysis phase, and are defined to be: 

p = Pr{algorithm indicates no-upset | system in upset state} 

and 

q =: Pr{algorithm indicates upset | system in no-upset state} 

We will consider four classes of p functions, each of which 
in some way quantifies the notion that as n increases, the sensi- 
tivity of the process implementation to upsets will also increase, 
and p will correspondingly decrease. The characteristics of these 
classes are summarized in Table 2. 

We will assume that increasing the data which is available 
to the analysis algorithm enhances the performance of the algo- 
rithm relative to false alarms as well as incorrect detections. Thus, 
we will allow q functions to belong to the same four classes pro- 
posed for p functions. 
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Class 

Function 

Comments 

Inverse Logarithmic 

* 

In n 

poor sensitivity to features/conditions, large p offset at high n, low detection pro- 
bability 

Decaying Exponential 

e‘*“ 

moderate sensitivity in short blocks, high sensitivity in longer blocks, sometimes 
requires several indications to correctly detect an upset 

Inverse Linear 

k 

n 

moderately high sensitivity for all block lengths, does not benefit from extra indi- 
cations in longer blocks, hence some upsets in longer blocks not detected 

Inverse Quadratic 

n 2 

excellent sensitivity in ill blocks, most rapid decrease, almost complete detection 
for large n 


Table 2 


4. The Probability of Correct Detection 

The primary performance goal of an upset detection pro- 
cedure is to detect as many of the upsets which occur in the sys- 
tem as possible. The probability of correct detection |lj, or simply 
the detection probability, is defined to be 

Pr{an upset detected | an upset occurs} 

The detection probability is a natural measure of upset 
detection capability. Clearly, this quantity depends on the time of 
occurrence of the upset. To remove such short term inconsisten- 
cies, it is natural to consider upset occurrences over a long period 
of time. If we define the detection probability over an interval, 
D(|t 1( t*)), to be 

D([t x ,t 2 )) = Pr{upset detected | upset occurs in 
then this can be accomplished by considering intervals with 

Specifically, for the data block capture and analysis pro- 
cess, we will consider the interval detection probability over a 
large number of monitoring periods. Thus, we will define the 
detection probability, D, in the following way: 

D - Urn D([0, i(n+T))) 

1—00 

where (0, n+T) is a single monitoring period of the process. If we 
let X represent the time of occurrence of the upset we can express 
the detection probability as 
l(n+T) 

D — lim / Pr{upset detected | X =* x} • 

1—00 Q 

f(x | upset occurs in [0, i(n+T))) dx 

Calculation of the detection probability of the data bicck capture 
and analysis process by the above formula requires knowledge of 
the conditional distribution of time of upset occurrence. This dis- 
tribution can be shown to be approximately uniform, assuming 
the mean time between upsets (1/X) is much larger than the mean 
upset duration (1 /m). Using this result along with the fact that 
the probability of an upset being detected depends only on its 
position within the data block capture and analysis monitoring 
period, we get the following: 

j >(n+*n 

D Si lim — — / Prfupset detected 1 X=*x}dx 

l-oo >(n+T) i X y 

n+T 

— lim — — — ^rr / Prfupset detected 1 X*x}dx 
l-oo i(n+T) { X ' 

a+T 

* / Prfupset detected | X *= x}dx (4.1) 


=- D(|0, n+T)) 

Thus, the detection probability of the data block capture and 
analysis process is simply equal to the interval detection probabil- 
ity over a single monitoring period. Now, 

Prfupset not detected | X» x) 

oo 

" ^Prfupset misacd in 1# * 1 analysis phases | 
l-i 

upset ends during i lh monitoring period}* 


Prfupset ends during i th monitoring period} 

- P (1 - e-^ n+T - x >) + £p l Prft<(i+l)(n+T) - x | 

J— 2 

t>i(n+T) - x} Prf t>i(n+T) - x} 


if 0 < x < n. By the memoryless property of the exponential dis- 
tribution, 

Prft < (i+l)(n+T) - x | t > i(n+T) - x} 

— Prft < n+T} — 1 - e’^a+T) 


Thus, 

Prfupset not detected | X»x} 

=* p 1 - e"^( n + T “*) + (I - e-Mn+T)) ^ p ! c -#.|l(n+TVs| 

L l-l 

’ (l - o)e^ a+T - x ) * 

= P 1 l-pe-M*^ 


Thus, 

Prfupset detected | X = x} 


- 1-p 


1 - 


(i - p) e -*‘<" +T - it > 


1 - pe-Mn+n 
Similarly, it can be shown that 


0 < x < n 


Prfupset detected | X — x} 


(1 - 

1 _ p e -*» +TI ’ 


(4.2) 


n < x < n+T 


(<•3) 

where the data analysis phase of the process takes place during 
[n, n+T). It remains only to evaluate Equation 4.1. The final 
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result is that the detection probability^ given by 

(1 - p) [(^n+l)(l-pe-^ ,,+T, )-(l-p)e-'‘ T ] 

° = Mn+TKl-pe-"^) 

S. The Occurrence of False Alarms 

While the probability of correct detection is an important 
measure of the performance of an upset detection procedure, it 
should by no means be the only one. It would be trivial to imple- 
ment a procedure which always claims that the system is in an 
upset state. Clearly, such a procedure has D *■ 1 at the expense of 
many false alarm occurrences. Given that false alarms will occur 
[14|, it may be worthwhile to trade otf correct detection capability 
and false alarm production. 

The above discussion leads us to consider a measure for the 
extent to which false alarms are produced. Let us define a random 
variable, F, as 

F number of false alarms between upset occurrences 

We will use E[F|, the expected number of false alarms per upset, 
as our false alarm occurrence measure. 

If a false alarm is regarded as a "success”, each decision 
produced by the process implementation while the system is in the 
no upset state is a Bernoulli trial with parameter q. Thus, 

N 

F- EBi 

l—l 

where B t represents the outcome of the i m decision and N is the 
number of decisions made between upset occurrences. If we let 

Y = sojourn time in no-upset state 


0. Detection Latency 

Another important characteristic of an upset detection pro 
cess is the amount of time between an upset’s occurrence and its 
subsequent detection. We will refer to this time as the detection 
latency of the process. 

Assuming an upset is correctly detected, we will define the 
detection latency, L, to be the time between the system entering 
the upset state and the time at which the upset is correctly 
detected. For the data block capture and analysis process, we will 
assume that the data analysis algorithm indicates whether or not 
the system was found to be in the upset state only at the end of a 
monitoring period. This forces the detection latency to be at least 
T, the length of the data analysis phase. As with the detection 
probability, we will consider upsets occurring in a single monitor- 
ing period, due to the periodicity of the data block capture and 
analysis process. Hence, we will define the expected detection 
latency of the process in the following way: 

EJL|=E{L j upset occurs in |0,n+T) and is detected] 

where, as before, [0, n+T) represents a single monitoring period of 
the data block capture and analysis process. If we let X represent 
the time of upset occurrence, the expected latency can be rewrit- 
ten as: 

n+T 

E[L|= J E(L I X=x| f(x I upset occurs in (0,n+T) 
o 

and is detected) dx (0.1) 

Given that X — x, L is a discrete random variable with sample 
space fl, given by 

0 = {n+T - x, 2(n+T) - x, 3(n+T) - x, . . .} 


where the sojourn time in a state is the length of time spent dur- 
ing a single visit to that state, then 


N* 


Y 

n+T 


Using results from probability concerning random sums [4| we get 
that 


E(F| - qE[N| 


Now, it can be shown that 


E|N|~ 


1 _ e -Mn+i) 


and the expected number of false alarms per upset is therefore 
given by 


E(FJ 


qe -X(n+n 

i _ e -M*+n 


Furthermore, the conditional distribution of L is given by 

Pr{L = i(n+T) - x | X = x} » 

(1 - p)p 1-2 , if n < x < n+T 
(1 - p)p M , if 0 < x < n 

From this the conditional expected value of L can easily be shown 
to be 

if 0 < x < n 
if n < x < n+T 

( 6 . 2 ) 

Now, f(x | upset occurs in [0,n+T) and is detected) can be calcu- 
lated from quantities derived in Section 4. Evaluation of Equation 
5.1 yields the following expression for the expected detection 
latency: 


E| L | X - x| 


n + T 
1-P 
n+T 
1-P 


- x, 

— x + n + T, 


To determine the optimum value of E[F| its behavior as 
the block length is allowed to vary must be determined. The fol- 
lowing lemma suggests the shape of E(F| for a wide class of q 
functions. 

Lemma 1: If q is a non-increasing function of n, then E|F| 
is a strictly decreasing function of n. 

Proof: e“ x * Q+TJ is a strictly decreasing function and 

1 - e -M&+T) j 3 a strictly increasing function. Thus, if q does not 

qe -Mn+T) 

increase with n, it must be that H is 1 3trictIy decrcaa * 

ing function. 


E(L| = 


Q*n + l)(n+T) 

1-p 


(l- pe -x(n+-n>. 

2(n+T)+(l-p)(i- n ) 

e -/r 


M 



(6.3) 


7. Evaluation of Performance Measures 

In this section we will consider in detail the performance of 
the data block capture and analysis process. The behavior of our 
performance measures will be examined as the length of the cap- 
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tured data block is allowed to vary. 


7.1. Linear Data Analysis Algorithms 
If we let 


Pi 


1-P 1 


(i - P )(t- > ‘ T -*- < * (D+ ' r| ) 
nn(l - pe-^ n+1n ) 


and 


P2 


(i - p)(i - rf) 
MT(l - pe-« 0+T >) 


then the detection probability is given by 


D 


np, + Tpj 
n+T 


(7.1) 


Since = an, the detection probability for a linear data 

analysis algorithm is 


D 


Pi + ap 2 
a 4- 1 


(7.2) 


The asymptotic behavior of a linear data analysis algorithm can 
be derived using Equation 7.2 and is stated in the following 
lemma. 


Lemma 2: For a linear data analysis algorithm, if p-+0 as 
n— *oo f then Iim D . 

n— oo a + 1 

Proof: If p— »0 as n— »oo, then Pi-+1 and p 2 -*0- We can 

then see from Equation 7.2 that D-* — . 

a + 1 


□ 


Typically, a > 1. In this situation, lim D < 1/2. Hence, 

n-oo 


capturing arbitrarily long blocks does not yield a high detection 
probability. The p functions being considered are all equal to, or 
arbitrarily close to, 1 for some small value of n. With p — 1, 
D » 0, so arbitrarily small block lengths yield a low detection pro- 
bability, as well. We would, therefore, like to examine the block 
length spectrum between n “ 0 and n « oo to determine whether 
a global maximum exists or whether the detection probability is 


bounded by its limiting value, — ^-y. In order to accomplish this, 


specific choices of p and q functions must be considered. 

A relatively conservative linear data analysis algorithm 
might have single monitoring period error probability functions 
k k' 

given by p = — and q =• . Figure 3 shows plots of the detec- 

n n 

tion probability, expected number of false alarms per upset, and 
the expected detection latency of such an algorithm for 2, 
k = 10, and k' =* 2X10“°. A value of X =* 10“ 10 is used 
throughout this section in calculating the expected number of false 
alarms per upset. The maximum detection probability, with 
M — 0.005, occurs at n ** 32 and has a value of 0.775. Thus, 
almost 80% of ail upsets are detected by such a scheme. Further- 
more, an interesting tradeoff can be achieved by noting that the 
expected number of false alarms per upset decreases very rapidly 
with n while the detection probability decreases slowly and the 
expected detection latency increases slowly. Because of this, small 
sacrifices in detection probability and expected detection latency 
yield a large payoff in terms of the expected number of false 
alarms per upset. For example, at n = 32, E[L| * 152.65 and 
E(F| =■ 6.510. When n — 92, D =* 0.707, E)L| — 333.70, and 
E|F] = 0.788. Thus, the number of false alarms which occur is 
decreased by a factor greater than 8 while the expected detection 
latency increases by a factor of about 2 and the detection proba- 


bility decreases by less than 10%. 

It is important tc determine if a given algorithm in a par- 
ticular fault environment can achieve a detection probability 
greater than the limiting value given by Lemma 2. The following 
theorem, stated without proof, gives necessary and sufficient con- 
ditions on the existence of a maximum as shown in Figure 3, for 
arbitrary values of a and k. 

Theorem li For a linear data analysis algorithm, with 


p = — , max D > 
n ill n 


— y-y if and only if ft < y. 


A less conservative linear data analysis algorithm should be 
able to detect more upsets by allowing more false alarms to occur. 

k k' 

Such an algorithm might have p = — and q = . Examina- 

n* n 

tion of such an algorithm for a = 2, k = 100, and k' = 5xlQ“ 7 
shows that the maximum detection probability has increased to a 
value of 0.874 at n = 26, while the expected number of false 
alarms per upset has increased to 19.G75 at the same block length. 
Thus, by using a more aggressive algorithm (which as a side-effect 
allows an increased number of false alarms to occur) it has been 
possible to detect almost 90% of all upsets in the system. Such a 
tradeoff would be beneficial in many cases. 

For any linear data analysis algorithm with a p function 
approaching D faster than l/n the global maximum exists indepen- 
dently of the choice of p, as is shown by the following theorem, 
also stated without proof. 

Theorem 2: For a linear data analysis algorithm, with 

k n 1 

p = «— - where lim -—7 — 0, max D > — , for ail ft. 

f(n) o-oof(n) ill q " 


a + 1 ' 


7.2. Higher Order Data Analysis Algorithms 

It may be possible to decrease the probabilities of incorrect 
rejection and false alarm in a single monitoring period by spending 
more time analyzing each data block. If the time required to 
analyze a block grows too quickly, however, large portions of sys- 
tem activity become invisible to the process, leading to poor 
overall performance. For any data analysis algorithm which has 
running time of order greater than n, the following limit result 
holds. 


Lemma 3: For any data analysis algorithm with n = o(T), 


lim D =* 0. 


D— OO 

Proof: From Equation 7.1, D = 

p 2 -+0 as n—>oo, regardless of p. Hence, D 
and n = o(T), we have that D-*0. 


npi + Tp 2 

n + T 
npi 

'"n + T' 


Note that 
Since < 1 


□ 


With higher order data analysis algorithms, since D is arbi- 
trarily close to 0 for small enough n and lim D = 0, clearly a glo- 

n— co 


bal maximum between 0 and oo exists, independent of p and ft. 
We will mainly be interested, then, in the value and position of 
this maximum, along with the behavior of the expected detection 
latency and the expected number of false alarms per upset. 

Use of a quadratic data analysis algorithm should produce 
small probabilities of incorrect rejection and false alarm over a sin- 
gle monitoring period. Examination of such an algorithm with 


parameter values 


k k' 

p = — , »nd q = — , with 

a = 0.2, b = c = 0, k =* 100, and k' = 5x 10 -5 , seems to show 
that quadratic data analysis algorithms are feasible only if used on 
very short data blocks. At n = 17, the maximum detection proba- 
bility is achieved with a value of 0.773. E|L| = 132.70 and 
E|F| = 23.130 at the same block length. For n > 17, there is a 
rapid decrease in the detection probability and a rapid increase in 
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the expected detection latency. For example, when n — 100, 
D = 0.141 and E|L| =* 2237 .32. The increase in performance over 
a single monitoring period is overwhelmed by the decrease in 
overall performance caused by the rapid growth rate of the non- 
visible fraction of system operation. 

It may be possible to achieve improved single monitoring 
period performance with logarithmic data analysis algorithms, 
which do not have a growth rate as rapid as that of quadratic 

It It/ 

algorithms. Such an algorithm with p = — , q = , and 

n~ n 

a * 2.3, k = 0.02, and k' =2X10"* is not burdened by the 
rapid detection probability decrease and expected detection 
latency increase characteristic of a quadratic data analysis algo- 
rithm. The maximum detection probability occurs at n = 21, 
where D * 0.333, E(L| =» 114.21, and E[F] — 12.444. When 
n =» 100, D = 0.541 and E(L| = 573.77 showing the more gradual 
degradation of performance inherent in the logarithmic algorithm. 
Hence, such algorithms seem to be potentially useful oyer a wide 
range of block lengths. 

For each data analysis algorithm studied, the expected 
detection latency appears to increase at the same rate as the 
amount of time spent analyzing a captured data block, after some 
initial deviation. This is indeed true, as shown by . the following 
theorem, stated without proof. 

Theorem 3: For any data analysis algorithm with 

analysis time T, such that n — G(T), and p— 0 , EjLj ~ cT, for 
some constant c. 

8, Conclusions 

A new procedure for upset detection in complex systems, 
called the data block capture and analysis process, has been 
presented. The upset detection capability of this process has been 
characterized in terms of process parameters by deriving the pro- 
bability of correct detection, expected number of false alarms per 
upset, and expected latency of the process. It has been shown that 
the detection probability can be maximized by a proper choice of 
parameters. In addition, it has been shown that improvement in 
any one of our detection measures can be achieved at the expense 
of one or both of the other measures. In particular, the detection 
probability can be increased by allowing a greater number of false 
alarms to occur. Examples have been shown where the process can 
detect almost 9Q% of all upsets while maintaining reasonable false 
alarm production and detection latency. These analytical results 
suggest that the data block capture and analysis monitoring pro- 
cess is a very effective means of providing upset detection in com- 
plex systems. 
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